duolingo english test
Responsible AI for Test Equity and Quality: The Duolingo English Test as a Case Study
Burstein, Jill, LaFlair, Geoffrey T., Yancey, Kevin, von Davier, Alina A., Dotan, Ravit
Artificial intelligence (AI) creates opportunities for assessments, such as efficiencies for item generation and scoring of spoken and written responses. At the same time, it poses risks (such as bias in AI-generated item content). Responsible AI (RAI) practices aim to mitigate risks associated with AI. This chapter addresses the critical role of RAI practices in achieving test quality (appropriateness of test score inferences), and test equity (fairness to all test takers). To illustrate, the chapter presents a case study using the Duolingo English Test (DET), an AI-powered, high-stakes English language assessment. The chapter discusses the DET RAI standards, their development and their relationship to domain-agnostic RAI principles. Further, it provides examples of specific RAI practices, showing how these practices meaningfully address the ethical principles of validity and reliability, fairness, privacy and security, and transparency and accountability standards to ensure test equity and quality.
- Europe > Switzerland (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Oceania > Australia (0.04)
- (6 more...)
- Summary/Review (1.00)
- Instructional Material (0.94)
- Research Report (0.64)
AI Research Director, Duolingo English Test at Duolingo - United Kingdom
This position is remote based in the United Kingdom. Our mission at Duolingo is to develop the best education in the world and make it universally available. But we've got more left to do -- and that's where you come in! Duolingo is the most popular language-learning application in the world, with over 500 million users and over half a billion exercises completed daily. Beyond our core learning product, we have also entered into literacy with Duolingo ABC and English proficiency testing with the Duolingo English Test.
Machine Learning Research Scientist
Our mission at Duolingo is to develop the best education in the world and make it universally available. But we've got more left to do -- and that's where you come in! Duolingo is the most popular language-learning application in the world, with over 500 million users and over half a billion exercises completed daily. Beyond our core learning product, we have also entered into literacy with Duolingo ABC and English proficiency testing with the Duolingo English Test. We are passionate about educating our users, making fact-based decisions, and finding innovative solutions to complex problems.